Non-flat Clusteringwhith Alpha-divergences
نویسندگان
چکیده
The scope of the well-known k-means algorithm has been broadly extended with some recent results: first, the kmeans++ initialization method gives some approximation guarantees; second, the Bregman k-means algorithm generalizes the classical algorithm to the large family of Bregman divergences. The Bregman seeding framework combines approximation guarantees with Bregman divergences. We present here an extension of the k-means algorithm using the family of α-divergences. With the framework for representational Bregman divergences, we show that an α-divergence based k-means algorithm can be designed. We present preliminary experiments for clustering and image segmentation applications. Since α-divergences are the natural divergences for constant curvature spaces, these experiments are expected to give information on the structure of the data.
منابع مشابه
Statistical manifolds from optimal transport
Divergences, also known as contrast functions, are distance-like quantities defined on manifolds of non-negative or probability measures and they arise in various theoretical and applied problems. Using ideas in optimal transport, we introduce and study a parameterized family of $L^{(\pm \alpha)}$-divergences which includes the Bregman divergence corresponding to the Euclidean quadratic cost, a...
متن کاملGeneralized Alpha-Beta Divergences and Their Application to Robust Nonnegative Matrix Factorization
We propose a class of multiplicative algorithms for Nonnegative Matrix Factorization (NMF) which are robust with respect to noise and outliers. To achieve this, we formulate a new family generalized divergences referred to as the Alpha-Beta-divergences (AB-divergences), which are parameterized by the two tuning parameters, alpha and beta, and smoothly connect the fundamental Alpha-, Betaand Gam...
متن کاملInformation Geometry of Positive Measures and Positive-Definite Matrices: Decomposable Dually Flat Structure
Information geometry studies the dually flat structure of a manifold, highlighted by the generalized Pythagorean theorem. The present paper studies a class of Bregman divergences called the (ρ, τ)-divergence. A (ρ, τ)-divergence generates a dually flat structure in the manifold of positive measures, as well as in the manifold of positive-definite matrices. The class is composed of decomposable ...
متن کاملFamilies of Alpha- Beta- and Gamma- Divergences: Flexible and Robust Measures of Similarities
In this paper, we extend and overview wide families of Alpha-, Betaand Gammadivergences and discuss their fundamental properties. In literature usually only one single asymmetric (Alpha, Beta or Gamma) -divergence is considered. We show in this paper that there exist families of such divergences with the same consistent properties. Moreover, we establish links and correspondences among these di...
متن کاملDually flat structure with escort probability and its application to alpha-Voronoi diagrams
This paper studies geometrical structure of the manifold of escort probability distributions and shows its new applicability to information science. In order to realize escort probabilities we use a conformal transformation that flattens so-called alpha-geometry of the space of discrete probability distributions, which well characterizes nonadditive statistics on the space. As a result escort p...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2011